Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.
SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
69,455
ITEMS
312.7M
VIEWS
collection
eye 312.7M
A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings.
Topics: daily, popular sites, Alexa
Top News
collection
48,925
ITEMS
119.8M
VIEWS
collection
eye 119.8M
A daily collection of hundreds of the world's top news sites.
Topics: daily, news
vkontakte.ru
collection
318
ITEMS
9.7M
VIEWS
by http://vkontakte.ru
collection
eye 9.7M
top_domains-00400
collection
603
ITEMS
9.2M
VIEWS
by Internet Archive
collection
eye 9.2M
top_domains-00350
collection
1,268
ITEMS
8M
VIEWS
by Internet Archive
collection
eye 8M
top_domains-00500
collection
959
ITEMS
7.8M
VIEWS
by Internet Archive
collection
eye 7.8M
top_domains-00300
collection
2,427
ITEMS
7.8M
VIEWS
by Internet Archive
collection
eye 7.8M
top_domains-00800
collection
2,034
ITEMS
7.8M
VIEWS
by Internet Archive
collection
eye 7.8M
top_domains-00900
collection
2,236
ITEMS
7.7M
VIEWS
by Internet Archive
collection
eye 7.7M
top_domains-00600
collection
2,399
ITEMS
7.6M
VIEWS
by Internet Archive
collection
eye 7.6M
top_domains-00250
collection
628
ITEMS
7.4M
VIEWS
by Internet Archive
collection
eye 7.4M
top_domains-00700
collection
775
ITEMS
6.9M
VIEWS
by Internet Archive
collection
eye 6.9M
tumblr.com
collection
447
ITEMS
5.9M
VIEWS
by http://tumblr.com
collection
eye 5.9M
top_domains-00400
web
eye 5.2M
favorite 0
comment 0
Source: top_domains-00400
top_domains-00450
collection
1,129
ITEMS
5.2M
VIEWS
by Internet Archive
collection
eye 5.2M
current.com
collection
320
ITEMS
5M
VIEWS
by http://current.com/
collection
eye 5M
top_domains-02750
collection
725
ITEMS
4.9M
VIEWS
by Internet Archive
collection
eye 4.9M
stumbleupon.com
collection
150
ITEMS
4.9M
VIEWS
by http://stumbleupon.com
collection
eye 4.9M
top_domains-09500
collection
1,682
ITEMS
4.6M
VIEWS
by Internet Archive
collection
eye 4.6M
xvideos.com
collection
1,465
ITEMS
4.6M
VIEWS
by http://xvideos.com
collection
eye 4.6M
pinterest.com
collection
96
ITEMS
4.3M
VIEWS
by pinterest.com
collection
eye 4.3M
top_domains-02500
collection
1,061
ITEMS
4.3M
VIEWS
by Internet Archive
collection
eye 4.3M
huffingtonpost.com
collection
1,059
ITEMS
4.3M
VIEWS
by http://huffingtonpost.com
collection
eye 4.3M
top_domains-01500
collection
1,047
ITEMS
4.1M
VIEWS
by Internet Archive
collection
eye 4.1M
top_domains-02250
collection
1,058
ITEMS
3.9M
VIEWS
by Internet Archive
collection
eye 3.9M
top_domains-07500
collection
580
ITEMS
3.9M
VIEWS
by Internet Archive
collection
eye 3.9M
top_domains-08750
collection
841
ITEMS
3.8M
VIEWS
by Internet Archive
collection
eye 3.8M
worldpress.org
collection
173
ITEMS
3.7M
VIEWS
by http://worldpress.org/
collection
eye 3.7M
top_domains-05250
collection
2,180
ITEMS
3.7M
VIEWS
by Internet Archive
collection
eye 3.7M
top_domains-02000
collection
595
ITEMS
3.5M
VIEWS
by Internet Archive
collection
eye 3.5M
time.com
collection
232
ITEMS
3.4M
VIEWS
by http://time.com
collection
eye 3.4M
xhamster.com
collection
755
ITEMS
3.3M
VIEWS
by http://xhamster.com
collection
eye 3.3M
top_domains-06750
collection
2,356
ITEMS
3.2M
VIEWS
by Internet Archive
collection
eye 3.2M
top_domains-06000
collection
1,990
ITEMS
3.2M
VIEWS
by Internet Archive
collection
eye 3.2M
taringa.net
collection
354
ITEMS
3M
VIEWS
by taringa.net
collection
eye 3M
newser.com
collection
107
ITEMS
2.8M
VIEWS
by http://newser.com/
collection
eye 2.8M
top_domains-01750
collection
482
ITEMS
2.8M
VIEWS
by Internet Archive
collection
eye 2.8M
top_domains-05500
collection
910
ITEMS
2.8M
VIEWS
by Internet Archive
collection
eye 2.8M
top_domains-04250
collection
554
ITEMS
2.8M
VIEWS
by Internet Archive
collection
eye 2.8M
answers.com
collection
64
ITEMS
2.8M
VIEWS
by answers.com
collection
eye 2.8M
top_domains-03000
collection
487
ITEMS
2.7M
VIEWS
by Internet Archive
collection
eye 2.7M
top_domains-03250
collection
525
ITEMS
2.7M
VIEWS
by Internet Archive
collection
eye 2.7M
sharelive.net
web
eye 2.7M
favorite 0
comment 0
Source: sharelive.net
top_domains-07000
collection
948
ITEMS
2.7M
VIEWS
by Internet Archive
collection
eye 2.7M
xnxx.com
collection
1,642
ITEMS
2.7M
VIEWS
by http://xnxx.com
collection
eye 2.7M
top_domains-06250
collection
436
ITEMS
2.6M
VIEWS
by Internet Archive
collection
eye 2.6M
sharelive.net
collection
4
ITEMS
2.6M
VIEWS
by sharelive.net
collection
eye 2.6M
top_domains-04000
collection
543
ITEMS
2.5M
VIEWS
by Internet Archive
collection
eye 2.5M
top_domains-09000
collection
725
ITEMS
2.5M
VIEWS
by Internet Archive
collection
eye 2.5M
top_domains-09750
collection
636
ITEMS
2.5M
VIEWS
by Internet Archive
collection
eye 2.5M
youtube.com
collection
82
ITEMS
2.5M
VIEWS
by http://youtube.com
collection
eye 2.5M
bbc.co.uk
collection
202
ITEMS
2.4M
VIEWS
by http://bbc.co.uk
collection
eye 2.4M
top_domains-06500
collection
878
ITEMS
2.4M
VIEWS
by Internet Archive
collection
eye 2.4M
top_domains-01250
collection
340
ITEMS
2.4M
VIEWS
by Internet Archive
collection
eye 2.4M
inn.co.il
collection
340
ITEMS
2.4M
VIEWS
by http://inn.co.il/
collection
eye 2.4M
top_domains-08500
collection
543
ITEMS
2.4M
VIEWS
by Internet Archive
collection
eye 2.4M
top_domains-04500
collection
415
ITEMS
2.3M
VIEWS
by Internet Archive
collection
eye 2.3M
top_domains-03500
collection
655
ITEMS
2.3M
VIEWS
by Internet Archive
collection
eye 2.3M
latimes.com
collection
212
ITEMS
2.3M
VIEWS
by http://latimes.com
collection
eye 2.3M
google.com
collection
106
ITEMS
2.2M
VIEWS
by http://google.com
collection
eye 2.2M
top_domains-01000
collection
595
ITEMS
2.2M
VIEWS
by Internet Archive
collection
eye 2.2M
ameblo.jp
collection
52
ITEMS
2.2M
VIEWS
by http://ameblo.jp
collection
eye 2.2M
top_domains-04750
collection
370
ITEMS
2.1M
VIEWS
by Internet Archive
collection
eye 2.1M
youporn.com
collection
2,085
ITEMS
2.1M
VIEWS
by http://youporn.com
collection
eye 2.1M
top_domains-08250
collection
1,222
ITEMS
2.1M
VIEWS
by Internet Archive
collection
eye 2.1M
top_domains-08000
collection
457
ITEMS
2.1M
VIEWS
by Internet Archive
collection
eye 2.1M
ehow.com
collection
225
ITEMS
2.1M
VIEWS
by ehow.com
collection
eye 2.1M
sfgate.com
collection
209
ITEMS
2.1M
VIEWS
by http://sfgate.com
collection
eye 2.1M
guardian.co.uk
collection
392
ITEMS
2.1M
VIEWS
by http://guardian.co.uk/
collection
eye 2.1M
top_domains-03750
collection
1,148
ITEMS
2M
VIEWS
by Internet Archive
collection
eye 2M
google.com.br
collection
37
ITEMS
2M
VIEWS
by http://google.com.br
collection
eye 2M
vkontakte.ru
web
eye 2M
favorite 0
comment 0
Source: vkontakte.ru
top_domains-05750
collection
579
ITEMS
2M
VIEWS
by Internet Archive
collection
eye 2M
top_domains-05000
collection
320
ITEMS
1.9M
VIEWS
by Internet Archive
collection
eye 1.9M
flickr.com
collection
677
ITEMS
1.8M
VIEWS
by http://flickr.com
collection
eye 1.8M